Papers with recurrent networks
Identification of Multiword Expressions in Tweets for Hate Speech Detection (2022.lrec-1)
Copied to clipboard
| Challenge: | Multiword expression (MWE) identification in tweets is a complex task due to the complex linguistic nature of MWEs combined with the non-standard language use in social networks. |
| Approach: | They propose a new architecture for incorporating multiword expression features into tweets to improve their accuracy. |
| Outcome: | The proposed system outperforms existing systems on the hate speech detection task on English Twitter. |
Graph-to-Sequence Learning using Gated Graph Neural Networks (P18-1)
Copied to clipboard
| Challenge: | Existing approaches to graph-to-sequence learning ignore the full graph structure, discarding key information. |
| Approach: | They propose a graph-to-sequence learning model that encodes the full graph structure and an input transformation that allows nodes and edges to have their own hidden representations. |
| Outcome: | The proposed model outperforms baselines in generation from AMR graphs and syntax-based neural machine translation while retaining the full graph structure. |
How much complexity does an RNN architecture need to learn syntax-sensitive dependencies? (2020.acl-srw)
Copied to clipboard
| Challenge: | Long-term memory (LSTM) networks are capable of encapsulating long-range dependencies . but simple recurrent networks (SRNs) have been less successful at capturing long-term dependencies and loci of grammatical errors in an unsupervised setting. |
| Approach: | They propose a new architecture that incorporates the decaying nature of neuronal activations and models the excitatory and inhibitory connections in a population of neurons. |
| Outcome: | The proposed architecture shows competitive performance relative to LSTMs on subject-verb agreement, sentence grammaticality, and language modeling tasks. |
Compositional Generalization by Factorizing Alignment and Translation (2020.acl-srw)
Copied to clipboard
| Challenge: | a crucial property underlying the expressive power of human language is its systematicity. |
| Approach: | They propose to make an analogous separation between alignment and translation in neural machine translation to capture compositional structure. |
| Outcome: | The proposed architecture outperforms existing neural networks on a compositional generalization task without supervision. |
Modeling Inter-Aspect Dependencies for Aspect-Based Sentiment Analysis (N18-2)
Copied to clipboard
Devamanyu Hazarika, Soujanya Poria, Prateek Vij, Gangeshwar Krishnamurthy, Erik Cambria, Roger Zimmermann
| Challenge: | Present neural-based models exploit aspect and its contextual information in the sentence but ignore inter-aspect dependencies. |
| Approach: | They propose to combine aspect-based sentiment analysis with temporal dependency processing to incorporate this pattern into a sentence. |
| Outcome: | The proposed approach is based on the SemEval 2014 dataset and shows that it is effective for predicting sentiments of aspects in sentences with multiple aspects. |
Modeling Recurrence for Transformer (N19-1)
Copied to clipboard
| Challenge: | Existing studies show that the lack of recurrence modeling hinders the development of a translation model. |
| Approach: | They propose to model recurrence for Transformer with an additional recurrent encoder. |
| Outcome: | The proposed model outperforms the deep model on EnglishGerman and ChineseEnglish translation tasks. |
Neural Dialogue State Tracking with Temporally Expressive Networks (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models ignore temporal feature dependencies across dialogue turns or fail to explicitly model temporal state dependencies in a dialogue. |
| Approach: | They propose to combine temporal feature dependencies in spoken dialogues by using recurrent networks and probabilistic graphical models. |
| Outcome: | The proposed model improves turn-level-state prediction and state aggregation on standard datasets. |
ExCL: Extractive Clip Localization Using Natural Language Descriptions (N19-1)
Copied to clipboard
| Challenge: | Prior approaches to retrieving clips within videos based on a given query are inefficient and text-clip similarity driven ranking-based approaches are far more complicated. |
| Approach: | They propose an extractive approach that extracts the start and end frames by leveraging cross-modal interactions between the text and video to generate a joint representation. |
| Outcome: | The proposed approach significantly outperforms state-of-the-art on two datasets and has comparable performance on a third. |
Self-Attention Networks Can Process Bounded Hierarchical Languages (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models that can process formal languages with hierarchical structure are limited in their performance. |
| Approach: | They propose to use a subset of Dyck-k with depth bounded by D to train self-attention networks. |
| Outcome: | The proposed model can process Dyck-(k, D) with depth bounded by D, which better captures the hierarchical structure of natural language. |
Bridging Robustness and Generalization Against Word Substitution Attacks in NLP via the Growth Bound Matrix Approach (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that adversarial examples can alter models' predicted sentiment due to their sensitivity to specific word choices. |
| Approach: | They propose a regularization technique to improve NLP model robustness by reducing the impact of input perturbations on model outputs. |
| Outcome: | The proposed method outperforms state-of-the-art methods in adversarial defense. |